Skip to content

docs: bootstrap first version of customizer plugin docs#313

Merged
gabwow merged 6 commits into
mainfrom
aalgo-223/update-ft-docs
Jun 15, 2026
Merged

docs: bootstrap first version of customizer plugin docs#313
gabwow merged 6 commits into
mainfrom
aalgo-223/update-ft-docs

Conversation

@gabwow

@gabwow gabwow commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

Summary by CodeRabbit

  • Documentation
    • Reorganized Customizer docs navigation and links to the new Customizer Reference routes; refreshed latest docs index and gated navigation (including updated troubleshooting entries).
    • Updated customization job guides (create/get/list/cancel) to use the platform Jobs service flow, with refreshed SDK examples and response payloads.
    • Clarified training/backends and removed DPO guidance; updated hyperparameters, dataset formatting validation, parallelism (now Context Parallelism), and sequence packing behavior/limitations.
    • Simplified examples by removing CLI tab variants in FileSet creation.

@gabwow gabwow requested review from a team as code owners June 12, 2026 18:34
@github-actions github-actions Bot added the docs label Jun 12, 2026
@coderabbitai

coderabbitai Bot commented Jun 12, 2026

Copy link
Copy Markdown

Review Change Stack

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

Migrates all customizer documentation internal links from /fine-tune-models/ to /customizer-reference/ paths, removes DPO training-type coverage across hyperparameters, data-format, and index pages, updates job lifecycle SDK examples to use the platform Jobs service API, and restructures Fern navigation YAML to expose the new customizer-reference section.

Changes

Customizer Documentation Restructuring

Layer / File(s) Summary
Navigation YAML: add customizer-reference tree, remove old entries
docs/fern/versions/latest.yml, docs/fern/gated-nav.yml
Adds full Fine-tune Models (customizer-reference) navigation subtree with nested pages and tutorials, plus Customizer troubleshooting entry to latest.yml; removes old Fine-tune Models section and Customizer troubleshooting entry from gated-nav.yml.
Training scope: remove DPO, rename parallelism, update Sequence Packing
docs/customizer/manage-customization-jobs/hyperparameters.mdx, docs/customizer/about.mdx, docs/customizer/models/data-format.mdx, docs/customizer/index.mdx
Removes DPO training type from hyperparameters quick-reference and data-format sections; renames Sequence Parallelism to Context Parallelism with updated parameter name; rewrites Sequence Packing limitations to generic support-variability description; removes "Align a Model with DPO" tutorial card; updates GPU memory guidelines.
Backend-specific job creation: Automodel, Unsloth, Knowledge Distillation
docs/customizer/manage-customization-jobs/create-job.mdx, docs/customizer/manage-customization-jobs/index.mdx
Replaces generic job-creation example with AutomodelJobInput/client.customization.automodel.jobs.create and UnslothJobInput sections; adds Knowledge Distillation section with training_type="distillation" and teacher_model fields; updates response JSON and LoRA output guidance.
Jobs service lifecycle: cancel, status, list via platform API
docs/customizer/manage-customization-jobs/cancel-job.mdx, docs/customizer/manage-customization-jobs/get-job-status.mdx, docs/customizer/manage-customization-jobs/list-active-jobs.mdx
Replaces client.customization.jobs.* examples with client.jobs.cancel/get_status/list calls; adds source filter for backend scoping; refreshes all example response JSON payloads.
Job reference, model entity, and FileSet simplification
docs/customizer/manage-customization-jobs/customization-job-reference.mdx, docs/customizer/manage-model-entities/create-model-entity.mdx, docs/customizer/manage-model-entities/create-fileset.mdx, docs/customizer/manage-model-entities/index.mdx
Updates Key Fields table to remove DPO and add backend-specific spec shapes; refreshes W&B and MLflow integration examples; rewrites model-entity job example to AutomodelJobInput; removes CLI tabs from FileSet creation sections.
Cross-page link migration to customizer-reference paths
docs/customizer/index.mdx, docs/customizer/models/index.mdx, docs/customizer/tutorials/*, docs/customizer/manage-customization-jobs/customization-job-reference.mdx
Retargets all remaining index, model catalog, and tutorial page links from /fine-tune-models/ to /customizer-reference/; updates tested-models introductory text to describe table as known-good combinations.

Possibly related PRs

  • NVIDIA-NeMo/nemo-platform#26: Overlaps on docs/customizer/about.mdx changes including dataset-formatting link targets and sequence-packing/unsupported-model guidance.

Suggested labels

chore

Suggested reviewers

  • yamini
  • mckornfield
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed Title accurately describes the primary change: bootstrapping initial documentation for the customizer plugin across multiple MDX pages, navigation configs, and API references.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch aalgo-223/update-ft-docs

Comment @coderabbitai help to get the list of available commands and usage tips.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@docs/customizer/models/data-format.mdx`:
- Line 12: The doc uses the incorrect config key `training_type`; update the
text to use the actual config key `training.type` everywhere this page
references `training_type` (e.g., the sentence starting "The required format
depends on the `training_type`"), so users are pointed to the correct job
configuration field; ensure any inline code snippets or examples also show
`training.type`.

In `@docs/fern/versions/latest.yml`:
- Around line 136-138: Remove the DPO tutorial entry from the published
navigation by deleting or commenting out the navigation block that references
"DPO Customization Job" (page: DPO Customization Job, path:
../../customizer/tutorials/dpo-customization-job.mdx, slug:
dpo-customization-job) in latest.yml so the DPO tutorial is not discoverable in
the published nav; alternatively move that block into a separate
gated/unpublished YAML file used for drafts so it stays in the repo but out of
the published navigation.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: cb305a49-0f09-4ea3-bd63-1331f80603b8

📥 Commits

Reviewing files that changed from the base of the PR and between c3cdc64 and c0bd830.

📒 Files selected for processing (20)
  • docs/customizer/about.mdx
  • docs/customizer/cli.mdx
  • docs/customizer/index.mdx
  • docs/customizer/manage-customization-jobs/cancel-job.mdx
  • docs/customizer/manage-customization-jobs/create-job.mdx
  • docs/customizer/manage-customization-jobs/customization-job-reference.mdx
  • docs/customizer/manage-customization-jobs/get-job-status.mdx
  • docs/customizer/manage-customization-jobs/hyperparameters.mdx
  • docs/customizer/manage-customization-jobs/index.mdx
  • docs/customizer/manage-customization-jobs/list-active-jobs.mdx
  • docs/customizer/manage-model-entities/create-model-entity.mdx
  • docs/customizer/manage-model-entities/index.mdx
  • docs/customizer/models/data-format.mdx
  • docs/customizer/models/index.mdx
  • docs/customizer/tutorials/import-hf-model.mdx
  • docs/customizer/tutorials/index.mdx
  • docs/customizer/tutorials/metrics.mdx
  • docs/customizer/tutorials/understand-configurations-and-models.mdx
  • docs/fern/gated-nav.yml
  • docs/fern/versions/latest.yml
💤 Files with no reviewable changes (1)
  • docs/fern/gated-nav.yml

Comment thread docs/customizer/models/data-format.mdx Outdated
Comment thread docs/fern/versions/latest.yml Outdated
@anubhutivyas anubhutivyas force-pushed the aalgo-223/update-ft-docs branch from c0bd830 to eef490e Compare June 13, 2026 01:46
@github-actions

Copy link
Copy Markdown
Contributor

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@docs/customizer/about.mdx`:
- Line 289: Replace the relative source link
"tutorials/optimize-throughput.ipynb" in docs/customizer/about.mdx with the
canonical Fern nav URL for that tutorial (use
"/documentation/tutorials/optimize-throughput"), keeping the link text
unchanged; update the markdown link target where the phrase "Optimizing for
Tokens/GPU" is referenced so the href uses the canonical /documentation/...
route instead of the relative .ipynb path to satisfy the internal-linking
guidelines.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: c6de9f28-c4ec-42cf-b0f5-0abcdd5a69c8

📥 Commits

Reviewing files that changed from the base of the PR and between c0bd830 and eef490e.

📒 Files selected for processing (21)
  • docs/customizer/about.mdx
  • docs/customizer/cli.mdx
  • docs/customizer/index.mdx
  • docs/customizer/manage-customization-jobs/cancel-job.mdx
  • docs/customizer/manage-customization-jobs/create-job.mdx
  • docs/customizer/manage-customization-jobs/customization-job-reference.mdx
  • docs/customizer/manage-customization-jobs/get-job-status.mdx
  • docs/customizer/manage-customization-jobs/hyperparameters.mdx
  • docs/customizer/manage-customization-jobs/index.mdx
  • docs/customizer/manage-customization-jobs/list-active-jobs.mdx
  • docs/customizer/manage-model-entities/create-fileset.mdx
  • docs/customizer/manage-model-entities/create-model-entity.mdx
  • docs/customizer/manage-model-entities/index.mdx
  • docs/customizer/models/data-format.mdx
  • docs/customizer/models/index.mdx
  • docs/customizer/tutorials/import-hf-model.mdx
  • docs/customizer/tutorials/index.mdx
  • docs/customizer/tutorials/metrics.mdx
  • docs/customizer/tutorials/understand-configurations-and-models.mdx
  • docs/fern/gated-nav.yml
  • docs/fern/versions/latest.yml
💤 Files with no reviewable changes (2)
  • docs/customizer/manage-model-entities/create-fileset.mdx
  • docs/fern/gated-nav.yml
✅ Files skipped from review due to trivial changes (9)
  • docs/customizer/tutorials/import-hf-model.mdx
  • docs/customizer/manage-model-entities/index.mdx
  • docs/customizer/tutorials/understand-configurations-and-models.mdx
  • docs/customizer/tutorials/index.mdx
  • docs/customizer/models/index.mdx
  • docs/customizer/tutorials/metrics.mdx
  • docs/customizer/index.mdx
  • docs/customizer/manage-customization-jobs/hyperparameters.mdx
  • docs/customizer/cli.mdx
🚧 Files skipped from review as they are similar to previous changes (2)
  • docs/customizer/models/data-format.mdx
  • docs/fern/versions/latest.yml

Comment thread docs/customizer/about.mdx Outdated
@github-actions

github-actions Bot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor
Suite Lines Covered Line Rate Branch Rate
Unit Tests 19462/25829 75.3% 60.9%
Integration Tests 11372/24601 46.2% 20.2%

Comment thread docs/customizer/about.mdx Outdated

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

♻️ Duplicate comments (1)
docs/customizer/about.mdx (1)

289-289: ⚠️ Potential issue | 🟠 Major | ⚡ Quick win

Replace the relative tutorial link.

This is the same dead-link issue previously flagged, and it’s still pointing at tutorials/optimize-throughput.ipynb instead of a canonical Fern URL. As per coding guidelines, internal links must use canonical nav URLs, not relative source paths.

🔧 Proposed fix
-Learn how to create a LoRA customization job with sequence packing by following the [Optimizing for Tokens/GPU](tutorials/optimize-throughput.ipynb) tutorial.
+Learn how to create a LoRA customization job with sequence packing by following the [Optimizing for Tokens/GPU](/documentation/customizer-reference/tutorials/optimize-throughput) tutorial.
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs/customizer/about.mdx` at line 289, In the file docs/customizer/about.mdx
at line 289, the link text "Optimizing for Tokens/GPU" uses a relative path
reference to tutorials/optimize-throughput.ipynb which violates canonical URL
guidelines. Replace the relative link path with the proper canonical Fern URL
that corresponds to the optimize-throughput tutorial, ensuring it follows the
project's internal link conventions for documentation references.

Source: Coding guidelines

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Duplicate comments:
In `@docs/customizer/about.mdx`:
- Line 289: In the file docs/customizer/about.mdx at line 289, the link text
"Optimizing for Tokens/GPU" uses a relative path reference to
tutorials/optimize-throughput.ipynb which violates canonical URL guidelines.
Replace the relative link path with the proper canonical Fern URL that
corresponds to the optimize-throughput tutorial, ensuring it follows the
project's internal link conventions for documentation references.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 7d45f672-69b8-4762-8eb2-f5d95f1fad7e

📥 Commits

Reviewing files that changed from the base of the PR and between 6b2b6c3 and 7a899a9.

📒 Files selected for processing (1)
  • docs/customizer/about.mdx

Comment thread docs/customizer/manage-customization-jobs/create-job.mdx Outdated
gabwow and others added 4 commits June 15, 2026 19:14
Signed-off-by: Aaron Gabow <agabow@nvidia.com>
Signed-off-by: anubhutiv <anubhutiv@nvidia.com>
Signed-off-by: Aaron Gabow <agabow@nvidia.com>
Signed-off-by: Aaron Gabow <agabow@nvidia.com>
Signed-off-by: Aaron Gabow <agabow@nvidia.com>
@gabwow gabwow force-pushed the aalgo-223/update-ft-docs branch from 7a899a9 to 477fab9 Compare June 15, 2026 23:14
gabwow and others added 2 commits June 15, 2026 19:44
@gabwow gabwow enabled auto-merge June 15, 2026 23:46
@gabwow gabwow added this pull request to the merge queue Jun 15, 2026
Merged via the queue into main with commit 583a727 Jun 15, 2026
50 of 51 checks passed
@gabwow gabwow deleted the aalgo-223/update-ft-docs branch June 15, 2026 23:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants